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Near-Equivalence  of  Network  Flow  Algorithms 


Abstract 


J 

? 


Network  problems  arising  in  practice  typically  have  non-negative 
arc  costs.  On  such  problems  we  show  that  the  following  algorithms 
perform,  modulo  ties,  the  same  sequence  of  flow  augmentations.' 

Simplex  (with  the  standard  pivot  rule  and  Big-M  start), 

Out-of -Kilter  (Primal-Dual), 

Dual  Simplex  (with  the  standard  pivot  rule), 

Lemke's  Complementary  Pivot  Algorithm. 

All  methods  confute  a  shortest  path  tree  by  mimicking  the  Dijkstra 
algorithm  and  then  send  flow  along  a  sequence  of  minimum  cost  paths. 
Differences  in  implementation  are  discussed.  It  becomes  clear 
that  Dantzlg's  simplex  method  with  the  best  empirical  pivot  rule 
(not  the  standard  rule)  will  outperform  other  methods  (variations 
of  Simplex  with  the  standard  rule).  A  simple  reason  is  given  why 
Dual  Simplex  (best  empirical)  cannot  do  as  well  as  Simplex  (best 
empirical).  It  is  noted  that  network  flow  problems 
pathological  examples  for  all  the  above  methods. 
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INTRODUCTION 


In  most  practical  transshipment  or  transportation  problems,  the 
initial  network  has  zero  flow  and  non-negative  arc  costs.  Problems  with 
some  negative  arcs  generally  arise  in  sensitivity  studies  and  may  be  put 
in  non-negative  form  by  a  transformation  [8  ]  [13]. 

In  this  paper  we  argue  that  the  best  known  algorithms  for  solving 
problems  with  non-negative  costs  are  basically  different  implementations 
of  the  same  general  method,  which  we  call  the  efficient  path  technique: 

1.  Start  with  zero  flow. 

2.  Compute  a  shortest  path  tree  (or  partial  tree)  using  Dijkstra. 

3.  Send  a  maximum  flow  along  the  shortest  s-t  path(s)  efficiently. 

4.  Recompute  new  shortest  path(s)  using  portions  of  the  previous 
shortest  path  tree. 

5.  Go  to  3  and  repeat  steps  3  an<^  ^  until  the  desired  level  of 
flow  is  reached. 

In  the  context  of  the  simplex  method,  step  4  corresponds  to 
determining  the  forward  unblocked  arc  of  minimum  modified  cost  in  a  cut. 
This  arc  is  then  joined  to  the  existing  basis  tree,  yielding  a 
shortest  s-t  path.  Step  3  corresponds  to  sending  flow  across 
that  path  until  an  arc  is  blocked  which  leaves  the  basis.  The  result 
is  a  new  cut . 

To  determine  the  incoming  arc.  Simplex  uses  node  numbers  {ir^}, 

(if ^  represents  the  distance  from  (s)  to  (i)  via  the  basis  tree)  and 
modified  costs  ir^  +  d ^  -  ir^  ,  where  d^  is  the  cost  of  arc  (i,j). 

The  relevant  modified  costs  In  Big-M  Simplex  differ  from  those  in 
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Out-of-Kilter  and  Dual  Simplex  by  a  constant  nt  -  M,  where  ^ 
is  the  length  of  the  current  shortest  s-t  path.  As  a  result 
the  methods  can  "bring  in"  the  same  arc.  The  process  of  revising 
costs  results  in  a  change  in  the  node  numbers  and  modified  costs 
(dual  variables)  similar  to  a  dual  pivot.  By  taking  M  =  it  ,  one 
sees  that  the  node  numbers  on  the  sink  side  of  the  cut  are  increased, 
decreasing  the  modified  costs  of  forward  arcs  in  the  cut  until  one 
becomes  zero.  The  same  process  occurs  in  the  Out-of-Kilter  method. 

The  dual  simplex  method  may  be  viewed  as  a  procedure  for  mani¬ 
pulating  infeasible  primal  trees.  Its  variables  are  non-negative 
modified  costs  and  unrestricted  node  numbers  which  generate  the 
same  modified  costs  as  Out-of-Kilter.  The  "complement"  of  the  dual 
basis  is  a  spanning  tree  containing  the  current  shortest  s-t  path. 
To  determine  its  incoming  variable.  Dual  Simplex  sends  flow  across 
the  shortest  s-t  path  until  the  required  level  of  s-t  flow  is 
reached,  even  though  this  violates  capacities  of  arcs  on  the  shortest 
path.  The  arc  whose  capacity  is  most  violated  (equivalently,  the 
first  arc  to  be  blocked)  leaves  the  complement  of  the  dual  basis. 

In  other  words  a  dual  variable  corresponding  to  that  arc  is  entered, 
forming  (with  the  other  dual  basic  variables)  the  same  cut  as  that 
found  by  Big-M  Simplex  and  Out-of-Kilter.  Potential  is  increased 
across  the  cut  until  some  modified  cost  goes  to  zero  and  leaves  the 
basis.  The  arc  corresponding  to  that  modified  cost  effectively 
enters  the  infeasible  primal  complement  forming  a  new  shortest  path. 

To  summarize,  when  viewed  as  a  primal  method  Dual  Simplex  sends 
flow  along  the  shortest  s-t  path  until  the  required  level  of  s-t 
flow  is  reached,  thus  creating  an  infeasible  solution.  It  does  the 
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same  operations  as  Simplex  but  in  the  reverse  order.  Determining 
the  outgoing  dual  variable  is  essentially  equivalent  to  determining 
the  incoming  primal  variable. 

Lemke's  algorithm  and  Simplex  (most  negative)  differ  only  in 
that  Lemke's  method  uses  a  simplex  pivot  in  the  dual  to  determine 
the  entering  variable  in  the  primal.  Basically  this  dual  pivot 
determines  the  forward  unblocked  arc  of  minimum  modified  cost  in  a 
cut.  Simplex  and  Out-of-Kilter  use  the  same  process  but  it  is  not 
formally  described  as  a  pivot. 

All  methods  can  be  made  to  Implement  Dijkstra  with  approximately 

the  same  degree  of  efficiency,  although  naive  Implementations  might 
3 

yield  0(n  )  procedures  for  the  first  shortest  path  computation  [19 J. 

For  subsequent  shortest  path  computations.  Simplex  keeps  most  of  the 
shortest  path  tree,  whereas  the  standard  version  of  Out-of-Kilter 
recomputes  it  using  a  max  flow  labelling  procedure. 

The  relative  efficiency  of  Simplex  (most  negative)  vs.  Out -of -Kilter 
on  networks  with  many  paths  of  equal  cost  is  unclear.  (Xat-of -Kilter 
essentially  computes  all  shortest  paths  at  once  and  then  uses  a  labeling 
method  to  compute  the  augmenting  paths  one  at  a  time.  The  textbook  version 
of  the  labeling  method  (Ford -Fulkerson)  throws  away  all  labeling  informaion 
after  each  augmentation  which  would  seem  inefficient. 

Simplex  computes  the  shortest  paths  one  at  a  time  and  simultaneously 
does  the  augmentation  (if  possible).  The  best  way  to  implement  this 
process  is  not  known.  Also  presently  unavailable  sore  published  results 
comparing  best  known  implementations  of  Simplex  (most  negative)  vs.  Out- 
of  Kilter.  What  is  known  is  that  other  pivot  rules  (not  most  negative) 


are  faster  than  an  Improved  version  of  Out-of -Kilter  [  1  ].  This  coincides 
with  empirical  results  for  general  linear  programs.  It  apparently  doesn't 
pay  to  find  the  "cheapest"  arc  in  a  cut  when  flow  will  probably  be  sent  on 
the  cheap  arc  one  has  already  found. 

IXial  Simplex  with  the  best  empirical  pivot  rule  can  not  do  as  well 

as  Simplex  (best  empirical),  because  regardless  of  the  pivot  rule,  Dual 

Simplex  must  decide  which  modified  cost  will  go  to  zero,  which  is  a 
2 

0(n  )  computation,  whereas  Simplex  (best  empirical)  can  avoid  this 
computation  and  must  decide  which  arc  will  become  blocked,  which  is 
0(n).  This  observation  explains  the  results  of  computational  studies 
13]  [11]. 

Starting  methods  such  as  Riase  I  -  Riase  II  which  involve  a  non-zero 
starting  flow  and  consequently  large  numbers  of  negative  cycles  seem  to 
be  inferior  [16]  to  starts  with  zero  flow  such  as  the  Big-M  method,  at 
least  on  general  minimum  cost  flow  problems.  When  started  with  non-zero 
flow,  equivalently,  negative  arc  costs,  we  show  that  Simplex,  Out-of- 
Kilter,  and  Lemke' s  method  behave  differently. 

Because  of  the  essential  equivalence  of  Simplex  (most  negative)  and 
Lemke' s  algorithm  on  non-negative  network  problems,  it  follows  that  the 
examples  from  [18]  are  pathological  for  both. 


A  minimum  cost  flow  or  transshipment  problem  requires  that  one 
send  a  specified  flow  v  from  a  source  s  to  a  sink  t  at  minimum 


cost.  lower  bounds  on  the  flow  in  each  arc  are  zero.  In  [19],  we 
showed  that  any  minimum  cost  circulation  problem  with  a  possibly 
infeasible  starting  solution  may  be  simplified  to  a  problem  of  the 
above  form.  In  the  following,  we  will  assume  that  arc  costs  are 
non-negative  unless  stated  otherwise. 

The  minimum  cost  flow  problem  may  be  written  as 

minimize  E  d^f^ 
subject  to  F(N,s)  -  F(s,N)  »  -v 


and 


F(N,i)  -  F(i,N)  =  0 


i  s,t 


F(H,t)  -  F(t,H)  =>  v 


where  d  s»  cost  per  unit  flow  on  (i,j) 


f±J  =  flow  on  (i,j) 


Cij  “  of  (i>J) 


v  =  required  s-t  flow 
N  =  node  set,  A  =  arc  set,  h  =  the  network 


F(i,N)  -  E  fy  =  flow  out  of  i  , 


jeN 


F(N,  i)  »  E  f  .  =  flow  into  i  . 


jeN 


Ji 


For  the  sake  of  simplicity,  we  will  assume  unless  otherwise  stated 
that  there  exists  at  most  one  arc  between  any  two  nodes. 


P* 


Pivots 


When  slack  variables  are  added  to  the  L.P.  formulation  of  the 
minimum  cost  flow  problem  and  a  redundant  equation  removed,  the  resulting 
system  has  n  -  1  +  |a|  equations  in  2|A|  unknowns,  where  |a| 
is  the  number  of  arcs,  and  n  is  the  number  of  nodes.  Any  simplex  basis 
may  be  represented  as  a  union  of  a)  two  variables  (flow  and  slack)  for 
each  arc  in  a  spanning  tree  and  b)  exactly  one  variable  (flow  or  slack) 
for  every  other  arc.  This  representation  is  hard  to  find  explicitly 
stated  in  the  literature  and  was  consnunicated  to  the  author  by  Richard  Stone. 

For  the  purpose  of  understanding,  cue  can  think  of  the  basis  as 
consisting  of  just  those  ares  (the  tree)  with  both  variables  in  the 
basis. 

Observation  1:  If  0  <  f  <  c^,  then  arc  (i,j)  is  automatically 
in  the  basis. 

To  bring  a  non-basic  arc  into  the  basis,  one  brings  In  that  arc’ s 
non-baslc  variable.  This  operation  farms  a  unique  cycle  of  basic  arcs 
(see  Figure  l).  In  a  non-degenerate  pivot,  flow  is  sent  around  the 
cycle  In  the  direction  determined  by  the  incoming  variable.  For 
example,  if  (i,j)  has  f^  =  c^,  then  entering  s^  (the  slack 
variable)  would  cause  f  to  decrease  (flow  is  sent  around  the  cycle 
in  the  direction  from  j  to  i).  The  amount  of  flow  sent  is  determined 
by  the  first  slack  (residual  capacity)  or  flow  to  go  to  zero.  The 
pivot  is  completed  by  removing  one  of  the  zero  variables  from  the 
basis,  making  its  associated  arc  non-basic.  In  practice,  many  basic 
arcs  may  have  flow  at  upper  or  lower  hounds  and  degenerate  pivots  sure 


common, 


Figure  lb:  Resulting  basis  after  the  slack  variable  for  arc  (1,3) 

is  entered  and  a  degenerate  pivot  performed  which  removes 
arc  (3,4). 


Figure  lc:  Resulting  basis  after  the  flow  variable  for  arc  (4,t)  is 

entered  and  the  slack  for  (2,4)  is  removed.  This  operation 
sent  one  unit  about  the  cycle  4t3l24.  The  slack  for  (4,t) 
could  have  been  removed  instead,  leaving  the  tree  of  basic 
arcs  unchanged. 
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Modified  Costs  and  Augmentation  Networks 

The  dual  variable  may  be  taken  to  be  the  cost  of  the  unique 
path  from  s  to  i  in  the  basis  tree,  whether  this  path  is  blocked 
or  not  (see  Figure  3). 

The  modified  cost  of  arc  (i,j),  denoted  by  d'  is  defined  to 
be  jt.  +  d  -  jt  .  This  is  the  cost  of  sending  one  unit  of  flow  in  the 

-1-  -L  J  J 

direction  from  i  to  j  about  the  cycle  formed  when  f  .  is  entered 
into  the  basis,  and  is  equal  to  the  simplex  modified  cost  coefficient 
for  fy. 

If  (i,j)  is  non-basic  with  flow  at  capacity,  it  can  only  become 
basic  by  entering  s  ,  or  equivalently,  decreasing  f  .  and  sending 
flow  around  the  cycle  in  the  opposite  direction.  The  cost  of  this 
operation  per  unit  flow  is  -(it^  +  d^  -  ),  which  is  the  simplex 

modified  cost  coefficient  for  s  .. 

The  following  definition  is  essential.  Let  f  be  a  flow  in  a 
network  h.  Then  the  augmentation  network  relative  to  f,  denoted 

f 

by  ft  ,  describes  the  ways  in  which  additional  flow  may  be  sent  on 

f 

each  arc.  h  is  constructed  as  follows: 


If  f(i,j)  >  0,  put  an  arc  (j,i)  e  lv  with  c  =  f  , 

J 1 

dji  =  "di  y 

If  f(i,j)  <  c^,  put  an  arc  (i, J )  e  hf  with  c^  =  c^ 
d^  is  unchanged. 


f 

V 


All  arcs  in  ft  have  zero  flow.  Figure  2  gives  an  example. 


Arc  in  original  network 

3, $-1,3 


i  i 


Corresponding  sire  in 
augmentation  network 

3,  $1,0 

i  ~ 3 


3, $1,0 


3, $1,0 


i 


J 


i 


j 


Figure  2:  Constructing  an  Augmentation  Network 


Observation  2:  The  simplex  modified  cost  coefficient  for  f  (s..) 

J  *■ 

equals  the  modified  cost  of  (i,j)  in  h  .  Thus  a  flow  f  is  of 


minimum  cost  iff  each  arc  in  n  has  non-negative  modified  cost. 


In  Figure  3,  casts  indicated  are  modified  costs,  i.e. ,  jt.  +  d  - 
The  actual  cost  per  unit  flow  of  "entering"  a  non-basic  arc  is  equal 

f 

to  the  modified  cost  of  the  associated  arc  in  h  .  Figure  3  shows 
how  node  numbers  (dual  variables )  and  modified  arc  costs  change  as 
pivots  in  Figure  1  are  performed.  Note  in  Figure  3c  that  a  fraction 
of  the  node  numbers  and  modified  arc  costs  must  be  updated  during  each 


pivot 


11 


Artificial  Starts 


To  apply  the  Simplex  method,  one  generally  uses  an  artificial 
start  because  an  initial  basic  feasible  solution  can  not  be  found 
otherwise. 

In  the  Phase  I  -  Phase  II  form  of  artificial  start,  the  Simplex 
method  is  first  used  to  compute  a  flow  of  value  v  without  concern 
for  cost.  This  flow  is  used  as  the  starting  solution,  and  Simplex 
reapplied. 

It  would  appear  that  a  better  technique  would  be  to  apply  a  fast 
max  flow  algorithm  (which  might  be  no  better  than  an  efficient  imple¬ 
mentation  of  Simplex),  to  a  network  consisting  of  the  cheaper  arcs. 

How  cheap  would  depend  on  the  ratio  between  v  and  the  maximum  flow. 
This  and  other  advanced  starting  procedures  are  currently  being 
investigated. 

In  the  Big-M  method,  tested  by  Mulvey  [16  ]  to  be  73^  faster  than 
current  versions  of  Phase  I  -  Phase  II,  an  artificial  arc  (s,t)  is 
added  with  a  large  cost  M  and  a  flow  of  value  v.  The  initial 
flow  in  the  network  is  zero.  Simplex  proceeds  by  sending  flow  along 
cheap  s  -  t  paths  (cheapest  s  -  t  paths  with  the  most  negative 
pivot  rule),  and  reducing  the  flow  in  the  artificial  arc.  When  the 
flow  in  (s,t)  reaches  zero,  the  solution  is  optimal  when  the  most 
negative  rule  is  employed.  Otherwise  additional  iterations  may  be 
necessary  to  eliminate  all  negative  cycles. 

Note  that  negative  cycles  initially  introduced  by  entering  "cheap" 
rather  than  "cheapest"  arcs  might  well  be  blocked  by  subsequent 
augmentations,  and  thus  not  exist  when  the  desired  level  of  flow  is 
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reached. 

An  example  of  a  Big-M  start  is  shown  in  Figure  4a.  The  starting 
basis  tree  for  Simplex  consists  of  artificial  arcs  running  from  s  to 
each  node.  Each  artificial  arc  has  cost  M  and  flow  zero,  except 
for  (s,t)  which  has  flow  v.  Using  the  most  negative  pivot  rule. 
Simplex  will  develop  a  basis  similar  to  that  shown  in  Figure  4b  prior 
to  the  first  cyclic  augmentation. 

Note  that  the  starting  artificial  basis  tree  could  just  as  easily 
be  rooted  baclcwards  from  t,  in  which  case  Simplex  (with  a  most 
negative  pivot  rule)  would  develop  a  shortest  path  tree  baclcwards  from 
t. 

Computational  results  in  [  1 ]  suggest  that  it  may  not  be  profit¬ 
able  to  start  with  a  complete  shortest  path  tree.  This  could  easily 
be  because  many  nodes  are  so  "out  of  the  way"  that  they  never  carry  flow. 

Figure  5  gives  the  node  numbers  and  modified  arc  costs  for  the 
first  two  pivots  which  occur  when  Simplex  is  started  with  the  basis 
shown  in  Figure  4c.  Dotted  arcs  are  non-basic.  Only  non-basic  arcs 
whose  modified  costs  involve  M  are  shown. 

Observation  3;  The  simplex  basis  in  Figures  5a,  b,  and  c  consists  of 
the  artificial  arc  (s,t)  together  with  two  trees,  one  rooted  from  s 
with  node  set  S,  the  other  rooted  into  t  with  node  set  T.  The 

f* 

entering  arc  is  determined  by  looking  in  h  for  the  forward  arc  of 
minimum  modified  cost  in  the  cut  (S,T).  The  corresponding  arc  in  h 


is  entered, 
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Figure  4a:  Dotted  arcs  represent  starting  artificial  basis  for 

Simplex.  Flows  on  all  arcs  other  than  (s,t)  are  zero. 


M,v 


Figure  4b:  Basis  for  Simplex  preceding  first  augmentation. 


Figure  4c:  Equivalent  basis  for  Simplex  containing  entire  shortest 
path  tree. 


Figure  5^:  Simplex  basis  after  the  first  augmentation  in  Figure  4c 
Are  (4,3)  was  saturated  and  left  the  basis. 


Definition:  Let  t .  be  the  cost  of  the  unique  path  from  i  to  J 
-iA. 


in  the  basis  tree  whether  or  not  that  path  is  blocked.  Let  p 

—ill 


represent  the  cost  of  the  cheapest  augmenting  path  from  i  to  J 
in  the  network. 


Theorem  1:  Given  a  Blg-M  start,  the  simplex  method  (with  a  most 
negative  pivot  rule)  will  construct  a  shortest  path  tree  in  the  same 


order  as  Dijkstra  to  all  nodes  i  such  that  p  <  p  .  Nodes  with 

Si  St 


Psi  >  pgt  will  be  connected  by  artificial  arcs. 

The  simplex  method  will  then  solve  the  problem  by  augmenting 
along  a  sequence  of  shortest  paths,  reducing  flow  in  the  artificial 
arc  (s,t)  during  each  augmentation.  The  optimal  solution  is 
obtained  when  the  flow  in  (s,t)  becomes  zero. 


Proof:  The  first  part  follows  by  induction.  Initially,  «  =  0 

8 

and  ■  M  Vi  6,  Note  that  the  modified  cost  of  arc  (i,j) 

equals  d  for  1  y  s,  and  for  i  =  s  equals  d  -  M.  Thus 

®  J 

the  first  arc  entered  will  be  the  cheapest  adjacent  to  s,  as  in 
Dijkstra  and  the  artificial  arc  adjacent  to  that  node  will  be  pivoted 
out  (by  a  degenerate  pivot). 

Suppose  inductively  that  Sluqplex  has  computed  a  shortest  path 
tree  to  a  set  of  permanently  labeled  nodes  P,  and  has  pivoted  out 
the  artificial  arcs  initially  associated  with  nodes  in  P  ~  s.  IBien 
the  current  modified  cost  of  (i,j)  for  i  €  P,  J  f  P,  will  be 
pgi  +  d^  -  M.  The  modified  cost  of  arcs  outside  the  cut  (P,P) 
will  not  involve  M.  It  follows  that  Simplex  will  enter  the  arc 
(i,j)  which  achieves  mini€p  ^  (pgl  +  d^}  as  in  Dijkstra. 
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To  prove  the  second  assertion,  nt  jat  the  first  augmentation 
will  occur  along  a  shortest  s-t  path.  In  general,  the  simplex  basis 
will  contain  the  arc  (s,t),  artificial  arcs  from  s  to  a  set  of 
nodes  J,  and  two  trees  S  and  3,  3  rooted  at  s  with  node  set 
S,  and  3  rooted  into  t,  with  node  set  T.  The  proof  will  be  given 
first  for  the  case  where  J  is  empty. 

Assume  inductively  that  Simplex  has  augmented  along  a  sequence 
of  shortest  paths,  and  that  t  <  p  V  j  e  S,  and  t..  <  p,.  V  j  e  T. 

6j  *“  8 J  Jt  —  Jt 

We  wish  to  show  that  Simplex  will  continue  to  satisfy  these  conditions, 
and  that  the  next  augmentation  will  be  along  a  shortest  path. 

In  what  follows,  let  the  unique  arc  between  i  and  J  in  A 
be  denoted  by  (i,j)  if  "entering  that  arc  in  the  basis"  causes  flow 
to  be  sent  from  i  to  j.  Otherwise  the  sure  is  denoted  ( j,i). 

Given  a  flow  f,  let  d  represent  the  cost  of  (i,j)  e  Thus 

"  dij  U  fU  *  clj>  “na  ‘  ^ji  u  fji  >  °- 

Suppose  (i,j)  «  h  is  a  forward  sure  in  the  cut  (S,T).  The 

modified  cost  of  (i,j)  in  hf  is  tgl  +  3^  +  tJt  -  M,  which  is 

just  the  cost  of  the  unique  s-t  path  formed  when  (i, j )  enters  the 

basis  minus  M.  Since  tgi  <  pgi  VIe  S,  and  tjt  <  Pjt  Vj  e  1, 

the  path  selected  by  Simplex  must  be  at  least  as  cheap  as 

minieS  jcT  ^si  +  dij  +  ®jt^*  w*lic*1  the  cost  of  the  cheapest  augmenting 

path.  It  suffices  to  shew  that  after  the  pivot  is  made  (which  may  be 

degenerate),  we  still  have  t  <  p  Vj  e  S,  t  <  p  yj  €  T. 

BJ  —  Sj  jt  “  jt 

Suppose  that  (i, J)  enters  the  basis  and  (k, l)  €  S  leaves. 

(The  case  (k,i)  e  JT  is  similar.)  Let  S'  be  the  portion  of  S 
connected  to  T  via  (i,j)  after  the  pivot.  Since  an  augmentation 
of  any  amount  (including  zero)  along  a  shortest  path  will  not  decrease 
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p  or  p  (see  [8]),  it  suffices  to  shew  that  t“fw  <  pold 

V  x  e  S’ .  Choose  x  e  S' .  Let  P  be  an  augmenting  path  from  x  to 

t  of  length  p^.  Let  y  be  the  node  on  the  previous  augmenting 

path  closest  to  x,  in  the  sense  that  the  nunfcer  of  basic  arcs  in 

the  unique  path  between  y  and  x  is  minimum.  Then  since  the 

previous  augmentation  occurred  over  a  shortest  path,  t  +  p  >  t 

yx  xx  yt 

or  p  .  >  t  .  -  t  =  t  ,  +  t  =  t  , . 
xt  -  yt  yx  yt  xy  xt 

We  will  now  extend  the  induction  to  non-empty  J.  It  suffices 

to  show  that  a  node  z  e  J  cannot  lie  on  the  cheapest  augmenting  s  -  t 

path,  and  that  when  z  leaves  J,  we  have  p  >  t  . 

sz  —  sz 

Given  a  simplex  basis  8  u  J,  with  (p,q)  a  forward  arc  of  minimum 

£ 

modified  cost  in  the  cut  (S,T)  in  ft  ,  let  t'  denote  the  cost  of  the 
unique  path  from  i  to  t  in  8  U  '3  U  (p,q). 

We  want  to  show  that  as  long  as  z  remains  in  J,  d^  >  t^. 


V  i  €  N.  This  will  imply  that  pgz  >  min^  (pgl  +  dizJ  >  mi^  (tBi  +  t^.}  » 

t^t>  and  since  pzt  >0  by  [  8  ],  the  result  will  follow. 

Consider  the  first  pivot  for  which  d  >  t'  for  some  x.  We 

xz  xt 

wish  to  show  that  z  will  join  S,  i.e. ,  some  arc  of  the  form  (i,z) 

has  minimum  modified  cost.  Suppose  Instead  that  (w,u)  has  minimum 

modified  cost  (see  Figure  6).  We  have  t’  -  t  +  t'  >  d  =»  t'  > 

xt  xy  yt  xz  yt 

t  +  d  =»  (w, u)  has  modified  cost  greater  than  (x,z).  » 

yx  xz 


Corollary  1:  The  Simplex  Method  with  a  Big-M  start  and  most 
negative  pivot  rule  will  yield  the  same  pivot  sequence  if  M  is  initially 
sex  at  zero  and  then  increased. 


Comment:  Corollary  1  establishes  the  relationship  between  Big-M 
Simplex  and  primal  dual  methods  such  as  Lemke' s  algorithm  and  Out-of- 
Kilter.  In  those  methods ,  the  essential  difference  is  that  M,  which 
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may  be  viewed  as  the  cost  of  the  current  cheapest  s-t  path,  is  slowly 
increased  by  a  sequence  of  "increases  in  potential  across  cuts"  instead 
of  being  fixed  at  one  value  throughout. 


# 


z 


Figure  6:  An  explanation  of  the  last 
argument  in  Theorem  1 
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Homotopy  Principle 


The  Homotopy  principle  has  wide  applicability  and  is  closely 
related  to  the  concept  of  artificial  variables.  For  network  flows  it 
is  similar  to  the  idea  behind  efficient  path  methods:  start  with  zero 
flow  and  build  up  to  the  desired  level.  Essentially  one  deforms  a 
problem  by  adding  one  artificial  variable  so  that  the  deformed  problem 
has  a  trivial  solution.  The  problem  is  then  solved  repeatedly  as  the 

i 

artificial  variable  is  driven  to  zero. 

To  deform  a  mi ni mum  cost  flow  problem  using  the  Homotopy 
principle,  an  artificial  arc  (s,t)  is  added,  along  which  a  flow  0v 
is  sent,  where  v  is  the  required  level  of  s  -  t  flow.  The  deformed 
problem  then  is 


minimize 
subject  to 


s  Vu 

F(N,s)  -  F(s,N)  =  -v  +  0v 
F(N,i)  -  F(i,N)  =  0  i  /  s,t 
F(N,t)  -  f(t,N)  =  v  -  0v 


0  *  fiJ  *  Cij 


For  0=1,  we  have  a  trivial  solution  f^  =  0,  which  is  the 
same  as  the  starting  solutions  for  Big-M  simplex  and  efficient  path 
methods.  For  0=0,  we  have  the  original  problem.  As  0  travels 
from  1  to  0,  the  solutions  obtained  are  optimal  for  the  flow  level 
v(l  -  0). 
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Complementary  Pivot  Theory 

Complementary  pivot  theory  can  be  used  to  solve  linear  programs 
as  well  as  quadratic  programs  and  bimatrix  games.  Basically  the  idea 
is  to  find  a  point  which  satisfies  complementary  slackness  and  is 
feasible  for  the  primal  and  dual  systems,  and  hence  optimal.  Lemke '  s 
algorithm  is  one  of  several  methods  [  4  ],  [15],  [17],  for  solving 
linear  complementarity  problems.  We  will  show  that  Lemke' s  procedure 
yields  a  sequence  of  solutions  similar  to  those  obtaL  ned  by  Dantzig' s 
simplex  method  when  both  are  applied  to  network  problems  with  non¬ 
negative  costs .  This  will  imply  that  network  problems  in  [18  ]  are 
pathological  for  Lemke* s  algorithm  as  well  as  for  the  simplex  method. 
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Application  of  Lemke' s  Algorithm  to 
Network  Flow  Problems 

Consider  the  problem  of  finding  a  minimum  cost  s  -  t  flow  of 
value  2  in  the  following  network.  To  write  this  as  a  Linear 

Jts  =  2 


Figure  7:  Network  for  the  minimum  cost  flow- 

problem.  Arc  (t,s)  is  added  with  a 
lower  bound  of  2  to  allow  replacement 
of  node  conservation  constraints  by 
inequalities. 


Complementarity  Problem  suitable  for  solution  by  Lemke' s  algorithm, 
the  node  conservation  equations  must  be  made  into  inequalities.  This 
may  be  accomplished  using  a  trick  suggested  by  Richard  Stone.  A 
reverse  arc  (t,s)  is  added  with  a  lower  bound  =  2,  and  each 

conservation  equality  constraint  is  replaced  by  an  inequality.  By 
following  the  inequalities  around  any  cycle,  the  reader  can  verify 
that  the  new  system  forces  equality  at  all  nodes.  An  equivalent 
formulation  of  the  minimum  cost  flow  problem  suitable  for  complementary 
pivot  algorithms  is  then 


minimize  0  •  f '  +  Z  d.,f,. 

ts  ij  ij 

subject  to  F(N,i)  -  F(i,N)  <  0 


-fts  <  -v 
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(1-J  >)<(*.«) 


fU  2  °  • 


The  dual  problem  is 


maximize 


v  +  Z  c. .ff. . 
ts  ij  ij 


subject  to  «  -  it.  -  k.  <0 

s  t  ts  — 


-«  +  it  +  a, .  <  d 
i  j  ij  -  ij 


(i,j)  /  (t>s) 

— u 

V°ij,Xts  -  0 

The  primal  problem  for  the  network  in  Figure  7  is 


minimize 

3fsi  + 

flt  + 

5fst  + 

0  • 

fts 

subject  to 

"fsl 

- 

fst  + 

fts 

<  0 

fsl  " 

flt 

<  0 

flt  + 

fst  - 

fts 

<  o 

fsl 

<  1 

flt 

<  2 

st 


-  f 


ts 


fij^° 


1  3 
<  -2 


The  dual  problem  is 
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maximize 
subject  to 


3sl  +  20lt  +  3ast  -  2\s 


-«  +  Jt, 

s  1 


+  a 


si 


-Jt 


-*1  +  nt 


+  n. 


+  a 


It 


+  a 


st 


1  3 
<  l 

1  5 


-  X .  <  0 

ts  - 


«±  1  0, 


aij  1  °> 


K.  <  0. 

ts  - 


We  have  chosen  to  use  (<)  constraints  in  the  primal  for  two 
reasons.  First,  it  is  desirable  to  have  as  many  slack  variables  as 
possible  in  the  primal  so  as  to  minimize  the  number  of  constraints 
affected  by  artificial  variables.  Secondly,  we  want  initial  dual 
pivots  to  form  a  shortest  path  tree  rooted  from  s .  Using  (<) 
constraints  accomplishes  both  objectives  but  requires  the  use  of 
negative  node  numbers.  Using  (>)  constraints  would  yield  positive 
node  numbers  but  causes  initial  dual  pivots  to  form  a  shortest  path 
tree  routed  backwards  from  t.  Figure  8  explains  how  the  optimal 
dual  solution  is  affected  by  the  primal  formulation  for  the  network 
shown  in  Figure  7.  In  Figure  8a,  the  conservation  equations  are 
written  as  (flow  in)  -  (flow  out)  >  0,  and  the  resulting  optimal  dual 
solution  has  non-negative  variables.  Tracing  through  the  sequence 
of  dual  pivots,  one  would  find  that  jt^  was  first  increased  to  1, 
then  and  increased  to  3  and  4  respectively.  In  other 

words,  initial  pivots  would  build  a  shortest  path  tree  backwards  from  t. 

By  changing  the  conservation  equations  to  (flow  out)  -  (flow  in)  >  0 
as  in  Figure  8b,  the  values  of  the  node  numbers  change,  but  the 


differences  -  itj  ],  in  absolute  value,  remain  the  same, 


2k 


The  formulation  we  use  in  Figures  9a-f  is  shown  in  Figure  8d. 

Note  that  adding  5  to  each  node 

number  would  yield  the  same  values 

as  in  Figure  8a. 

Primal  Formulation 

Optimal  Dual  Solution 

fts  "  fsl 

-  fst  >  0 

fsl  " 

flt 

-fts  + 

flt  +  fst  ^  0 

0=1 

(- 

0  4  5 

(flow  in)  - 

(flow  out)  >  0 

fts  +  fsl 

+  fst  >  0 

'  fsl  + 

flt  >° 

fts 

flt  -  fSt  £  0 

0=1 

( - ■— « - - 

(- 

V  ^(-ciP 

510 

(flow  out) 

-  (flow  in)  >  0 

fts  “  fsl 

-  fst  <  0 

fsl  " 

flt  <° 

•f.  + 

ts 

f  It  +  f  st  1  0 

0  =  -1 

0-4-5 

(flow  in)  - 

(flow  out)  <  0 

•f '  +  f  n 

ts  si 

+  f  .  <  0 
st  — 

-  fsl  +  flt  <  0 

fts 

fit  -  f.t  i 0 

0  =  -1 

(fy)  <(.„) 

-5  -1  0 

(flow  out)  -  (flow  in)  <  0 


Figure  8:  An  example  of  how  the  dual  solution  varies  as  a 
function  of  the  primal  formulation 
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An  Example 


Recall  that  Lemke1  s  algorithm  seeks  a  point  satisfying  both 
primal  and  dual  systems,  and  complementary  slackness.  To  find  such  a 
point  for  the  network  in  Figure  7,  the  primal  and  dual  systems  are 
written  in  a  tableau,  as  shown  in  Figure  9a.  The  first  three  primal 
slacks  are  denoted  ng,  n^,  and  n^.,  standing  for  node  slacks,  which 
may  be  thought  of  as  artificial  arcs  (from  s).  The  next  three  primal 


slacks  are  denoted  c^,  ,  Cst*  anc*  are  residual  capacities. 


There  is  one  surplus  variable,  The  four  dual  slacks  are 


denoted  d',,  d ’  ,  d'  ,  d'  ,  standing  for  modified  costs.  Note  that 
si  It  st*  ts’  & 


the  first  four  rows  contain  the  dual  system,  written  in  terms  of 


-it  ,...,-X  ,  to  keep  everything  positive,  and  the  last  seven  rows 

S  St 


contain  the  primal  system.  An  artificial  variable  Zq  must  be 


added  to  the  primal  system  to  make  all  components  of  q,  the  vector 

of  basic  variables  non-negative. 

Column  i  is  complementary  to  column  i  +  11,  i  =  1,...,11, 

meaning  that  both  columns  cannot  appear  in  the  same  basis  (this  is 

the  complementary  slackness  condition).  The  initial  infeasible 

basis  consists  of  slack  variables  with  one  surplus  variable,  l '  . 

ts 


Figure  9b:  The  first  pivot.  Dual  variables  in  the  tableau 
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Figure  9<i 
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Sequence  of  Pivots 


Entering 

Variable 

Exiting 

Variable 

Comnent 

zo 

£i 

ts 

zQ  is  entered  to  make  q  non-negative. 

\s 

d» 

ts 

Degenerate  pivot. 

fts 

Hg 

Die  primal  begins  to  construct  a  shortest 

path  tree  by  pivoting  out  the  node  slacks. 

n 

s 

sl 

Die  dual  begins  to  determine  node  numbers 

corresponding  to  the  shortest  path  tree. 

it  is  new  -3. 
s 

fsl 

°1 

Another  node  slack  leaves  in  a  degenerate  pivot 

*1 

"it 

Potential  is  increased  across  the  cut  (sl,2t) 

by  1,  making  «s  =  -4  and  jt^  =  -1. 

flt 

ck 

Augmentation  of  one  unit  across  the  path 

sit  saturates  arc  (s,l). 

°sl 

d» 

st 

Increase  in  potential  of  1  across  the  cut 

(s,32t)  makes  d^t  zero. 

fst 

Z0 

Augmentation  of  one  unit  across  the  path 

(s,t)  drives  out  zQ. 
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Summary 


The  complementary  pivot  algorithm  alternates  between  primal 
and  dual  pivots,  which  are  disjoint.  The  dual  pivot  may  be  viewed 
as  a  process  for  determining  which  non-basic  variable  in  the  primal 
has  the  minimum  modified  cost  coefficient.  The  algorithm  begins 
by  entering  an  artificial  variable  to  make  the  initial  basis 

of  slacks  non-negative.  This  determines  a  unique  sequence  of 
alternating  primal  and  dual  pivots  in  a  non-degenerate  system. 


The  variable  which  enters  in  each  case  is  the  complement  of  the 
leaving  variable.  Thus  when  zQ  enters,  knocking  out  the 


complement  of 

'ts* 

namely  \tg. 

enters  in  the 

dual.  This  eliminates 

the  dual  slack 

dts 

which  allows 

fts 

into  the  primal,  which  in 

turn  knocks  out 

V 

allowing  s 

S 

to 

enter  the 

dual  system.  The 

value  of  jtg  becomes  -3,  which  means  the  potential  across  the  cut 
(s,12t)  is  increased  by  3,  the  cost  of  the  cheapest  arc  in  that  cut, 


equivalently,  the  cheapest  arc  adjacent  to  s.  The  same  computation 

occurs  in  the  Oit-of -Kilter,  Primal-Dual,  Big-M  Simplex,  and  Dijkstra 

methods.  Setting  it  to  -3  makes  the  modified  cost  of  arc  (s,l) 

s 

zero  (it  becomes  "admissible" ),  and  f  ^  is  allowed  to  enter  the 
primal  basis. 

Subsequent  dual  pivots  determine  values  of  (node  numbers) 

which  correspond  to  a  shortest  path  tree  rooted  at  s.  The  node  numbers 
are  introduced  in  the  same  order  as  in  Dijkstra.  In  the  primal,  node 
slacks  (which  may  be  thought  of  as  artificial  arcs)  are  eliminated  and 
replaced  by  arcs  pivoted  in  at  a  zero  level  forming  a  shortest  path  tree. 
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Neglecting  nt>  which  corresponds  to  the  added  constraint, 
the  sequence  of  primal  basis  "trees"  associated  with  tableaus 
9c-9f  is  {(s,1),zq},  {(l,t),z0),  and  {(s,t), (l,t)}.  This 

is  the  same  sequence  that  would  appear  in  the  Big-M  Method. 

The  augmentation  process  may  he  described  as  follows:  The  last 


node  number  to  enter  the  dual  system  forces  the  modified  cost  of  some 
arc  (j,t)  to  zero,  allowing  f ..  to  enter  the  primal.  This  causes 

J  i- 

an  augmentation  which  saturates  some  arc  (u,v),  thereby  allowing  an 
increase  in  potential  across  the  dual  "cut"  containing  (u,v).  The 
increase  in  potential  drives  the  modified  cost  of  some  arc  (p,q)  in 


that  cut  to  zero,  allowing  f  to  enter  in  the  primal.  Some  primal 
pivots  may  be  degenerate,  meaning  that  increases  in  potential  across 


several  cuts  must  be  made  before  additional  flow  can  be  sent.  Successive 


augmentations  continue  in  this  fashion,  reducing  the  -value  of  zQ  until 
it  becomes  zero,  at  which  point  the  solution  is  optimal. 

In  order  to  prove  the  essential  equivalence  of  Lemke' s  algorithm 


and  the  Simplex  method  on  non-negative  network  problems,  it  is  necessary 


to  study  the  application  of  the  Simplex  method  to  the  dual  problem  in 
more  detail.  Some  of  the  material  in  the  following  section,  notably 
Theorem  2  and  the  essence  of  Figure  12,  was  communicated  to  the  author 
by  Robert  Bland,  and  will  be  appearing  in  one  of  his  forthcoming  papers. 
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Interpretation  of  the  Dual 


In  this  section  we  will  for  the  purposes  of  comprehension  deal 
with  non-negative  by  rewriting  the  dual  problem  as 


maximize 

\v 

-  T.  c  a. . 
ij  ij 

subject  to 

n 

s 

-  +  K  <0 

-n . 

+  jt  -  a,  .  <  d  . 

i 

J  ij  “  ij 

v  V  x  - 0  • 


With  this  understanding,  the  optima.!  value  of  may  be  inter¬ 

preted  as  the  length  of  the  shortest  augmenting  path  from  s  to  i 
during  the  last  network  augmentation,  or  afterwards  if  an  augmenting 
path  still  exists.  To  see  that  an  augmenting  path  to  each  node  i 
exists  prior  to  the  last  augmentation,  note  that  such  a  path  from  s 
to  t  exists.  Xf  all  direct  paths  from  s  to  i  have  been  blocked, 
then  the  flow  on  some  path  from  i  to  t  may  be  rediced,  yielding  an 
augmenting  path  s  -* t  i. 


To  interpret  cr.  note  that  the  dual  equation  -n.  +  n.  -  o.  .  <  d 
i j  i  J  ij  ~  ij 

may  he  rewritten  as  -o^j  <  +  d^  -  jij.  The  quantity  +  d^  - 

is  just  the  modified  cost  of  arc  (i,j).  In  a  basic  dual  solution. 


a. .  and  the  slack  for  the  above  equation,  namely  s  ,  cannot  both 

i  j 

be  in  the  basis.  In  other  words. 


”°ij  =  the  cost  of  arc  (i,j)  when  negative, 

»  the  modified  cost  of  arc  (i,j)  when  positive. 

The  objective  function  is  maximized  when  \  *  In  general  \ 

may  be  interpreted  as  the  length  of  the  current  shortest  s-t  augmenting 
path. 
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Dual  Bases  and  Pivots 

Consider  the  problem  of  finding  a  minimum  cost  s  -  t  flow  of 
value  5  in  the  network  in  Figure  10b.  The  arc  with  capacity  1 
and  cost  6  will  be  referred  to  as  (s~2).  A  reverse  arc  (t,s) 
is  added  with  a  lower  bound  of  5  to  yield  a  circulation.  Hon- 
negative  dual  variables  are  obtained  by  writing  the  primal  problem 
as 
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Figure  10  shows  the  initial  tableau  with  K  and  six  slacks  corre¬ 
sponding  to  positive  modified  costs  (their  columns  not  shown)  in  the 
basis.  The  first  pivot  enters  at  a  value  of  1,  driving  d^  to 

zero,  and  increasing  A.  to  1.  The  second  and  third  pivots  yield 

jr  a  1,  jt  =  3,  n  =  \  =  4  determining  s2t  as  the  cheapest  s  -  t 
t 

path.  The  dual  objective  function  is  3*4=  20,  which  is  a  lower 
bound,  since  5  units  must  be  sent  and  the  cost  per  unit  will  be  at 
least  4. 

* 

The  variable  \  corresponds  to  an  arc  between  s  and  t  in 
the  dual  graph.  Each  successive  which  enters  eliminates  a  slack 

variable  until  in  Figure  lOh,  the  union  of  \  and  the  slacks  forms  a 
tree  in  the  dual  graph.  Further  pivots  will  involve  only  variables 
representing  +  modified  costs;  n  ,  and  will  not  leave. 


and  n  being  zero  throughout,  will  not  enter. 

G 
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Remaining  pivots 


Comment 


1. 


2. 


3- 


4. 


°S2 

1 

— >  0 

12 

'  -L. 

^t 

->  0 

a  - 

-» 1 

si 

d!s. 

-»  0 

S2 

o  . 

-» 1 

2t 

n 

-»  0 

12 

Increase  in  potential  of  1  across  cut 

(s,22t)  determines  new  incoming  primal 

variable  f  , . 

si 

Increase  in  potential  c0  1  across  (sl,2t) 
determines  new  incoming  primal  variable  f  . 

Allows  f  ^  to  enter  primal  but  primal  pivot 

s2 

is  degenerate. 

Increase  in  potential  of  1  across  (s2,lt). 


Comparison  of  Dual  Simplex  to  Big-M  Simplex 


Figures  11a,  c,  and  e  show  the  infeasible  primal  bases  associated 
with  the  feasible  dual  solutions  in  Figures  lOg,  i,  and  k.  Note  in 
Figure  11a  that  the  capacities  of  arcs  (s,2)  and  (2,t)  are  exceeded 
by  4  and  3  respectively,  and  these  are  precisely  the  modified  cost 
coefficients  of  and  in  Figure  lOg.  In  other  words,  the 

modified  cost  coefficient  of  equals  f ^  -  c  ,  which  is  just 

-c^..  A  comparison  of  Figures  lOh  and  11a,  lOj  and  He,  etc.  shows  that 
primal  and  dual  basis  trees  do  not  intersect  (complementary  slackness 
holds ) . 


Figure  lib  gives  the  Big-M  solution  corresponding  to  Figure  11a. 

Note  that  the  infeasible  primal  solution  associated  with  the  dual 
simplex  method  is  obtained  from  the  Big-M  solution  by  routing  the  flow 
on  (s,t)  along  the  current  shortest  s  -  t  path  in  the  primal,  thus 
violating  the  capacities  of  arcs  along  that  path.  The  arc 
whose  capacity  is  most  violated  is  the  first  arc  to  be  saturated 
as  flow  is  increased.  This  arc  is  pivoted  out,  yielding  the  same  cut 
as  in  the  Big-M  method. 

The  Big-M  node  numbers  and  modified  costs  across  the  cut  after 
(s,2)  is  pivoted  out  are  shown  in  Figure  lid.  The  Big-M  modified 

f 

costs  for  forward  arcs  across  the  cut  in  h  differ  from  the  modified 
costs  for  the  associated  dual  simplex  solution  shown  in  Figure  Ilf  by 
a  constant  (jt^  -  M).  Therefore  the  methods  can  select  the  same  incoming 
arc,  and  will  perform  the  same  pivot  sequence  on  non-degenerate  problems. 


t 

Lm 
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Figure  11a:  Infeasible  primal  basis 

corresponding  to  Figure  lOg. 

Dotted  arcs  are  non-basic  with  zero  flow. 


Figure  lib:  Big-M  basis  corresponding 
to  Figure  11a. 


7-M 


M-3 

Figure  11c:  Infeasible  primal  basis  Figure  lid:  Node  numbers  and  modified 

corresponding  to  Figure  lOh.  costs  for  Figure  lib. 

Only  arcs  with  flow  are  shown. 


Figure  He;  Infeasible  primal  basis 

corresponding  to  Figure  lOi. 


Figure  Ilf:  Node  numbers  and  modified 
costs  when  M  =  4-,  the 
length  of  the  current 
shortest  path. 
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Observe  that  the  computation  required  to  determine  the  outgoing 
arc  is  order  0(n),  where  n  is  the  number  of  nodes,  whereas  the 

O 

computation  required  to  determine  the  incoming  arc  is  order  0(n  ), 

n2 

since  there  may  be  as  many  as  arcs  in  a  cut.  This  explains 

why  Dual  Simplex  (best  empirical)  does  not  seem  to  be  as  good  as 
Simplex  (best  empirical).  By  not  searching  for  the  best  arc  to  remove, 
one  saves  at  most  0(n). 

Dual  Simplex  should  be  computationally  similar  to  Out -of -Kilter 
since  both  find  the  best  arc  in  each  cut.  This  coincides  with  computa¬ 
tional  results  [11]. 

Figure  12  shows  how  the  dual  problem  may  be  formulated  as  a  minimum 

cost  flow  problem  when  the  primal  network  is  planar  [  2 ].  Increases  in 

potential  across  cuts  may  be  viewed  as  augmentations  of  potential  from 
*  * 

s  to  t  in  the  dual  graph.  Saturations  in  the  dual  graph  occur 
when  a  positive  modified  cost  goes  to  zero.  Note  that  each  arc  in  the 
primal  has  two  arcs  associated  with  it  in  the  dual,  a  slack  arc  with 
zero  cost  and  capacity  equal  to  d^,  and  an  arc  with  cost  equal  to  c^ 
and  infinite  capacity  corresponding  to 

The  following  theorem  allows  a  rigorous  characterization  of  dual 
bases,  and  was  communicated  to  the  author  by  Robert  Bland. 


Theorem  2:  Let  (7^.,  and  s^  represent  the  dual  column  corre¬ 
sponding  to  the  variable  <3^,  and  respectively.  Then  a  set 


of  columns  u  u 


is  independent  in 


X  ^  ^ (i,j)eKCIc 

the  dual  system  if  the  edges  in  I  u  K  do  not  contain  any  cutsets. 


Proof:  Note  that  the  column  corresponding  to  it^  contains  1* s 
for  arcs  leading  into  i  and  -1*  s  for  arcs  leading  out.  In  other 
words,  it  represents  the  cut  (N  ~  i,i).  Similarly,  0^  and  s^ 
one  1  or  -1,  they  represent  the  arc  (i,j).  Any  non-zero  linear 


have 
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(*) 


combi nation 


L  a.  it.  of  columns  in  fit,}.  / 
1  1  1  i'ijfcs 


will  have  non-zero 


ieX 


elements  for  every  forward  and  reverse  arc  in  the  cut  (X,X).  Hence 
a  set  of  columns  fjt^}  u  [c^ }  U  [s^ }  can  not  be  dependent  if  the 

.  A  •  _  A  . 

edges  corresponding  to  l^jJ  u  {s^ }  do  not  contain  any  cutsets.  El 


Hie  following  definition  gives  a  precise  correspondence  between 
primal  and  dual  bases.  Recall  that  A  is  the  set  of  arcs  and  that 
at  most  one  arc  is  assumed  to  exist  between  any  pair  of  nodes. 


Definition :  Let  B  =  S  U  J  U  (s,t)  be  a  basis  tree  for  the 
Big-M  method  with  (s,t)  the  only  artificial  arc  and  let  £  denote 
the  arc  which  just  left  the  basis. 

The  corresponding  primal,  infeasible  basis  associated  with  the  Dual 
Simplex  method  is  defined  to  be  D  =  S  U  3  U  £ Let  ^(i)  denote 
the  shortest  distance  from  s  to  i  in  a  tree  T. 

The  basic  dual  feasible  solution  associated  with  D  is  denoted 
by  5,  and  defined  as  the  tuple  {j^},  (s^),  where 


U 

7ij 

Jij 

Sij 


=  jt^Ci)  V  i  €  N  ~  s. 

"  V 

=  «i  +  d  -  jt  if  positive  and  (i,j)  e  A. 


=  -jt,  -  d, .  +  K .  if  positive  and  (i,j)  €  A. 
1  J 


=  o 

if 

ni  +  dij 

"  ”j  =  °’  fij  “ 

=  0 

if 

*i  +  dij 

•  • 0>  f«  ■ 

Cij  and  ^1,J^  ^  D# 
0  and  (i,j)  4  D. 


All  other  variables  are  non-basic  and  eq.ua!  zero. 


Remark:  It  is  easy  to  verify  that  {s1J},  {o^)  is 

feasible  for  the  dual  system.  It  is  basic  feasible  because  the 
columns  associated  with  it  contain  no  columns  of  D  and  hence  are 


independent  by  Theorem  2. 

The  following  lemma  observes  that  modified  costs  relative  to  a 
Big-M  basis  differ  from  modified  costs  associated  with  the  corre¬ 
sponding  dual  solution  only  along  the  cut  (S,T),  where  they  differ 
by  a  constant. 

Temmn.  1;  Let  D  be  a  tree  with  node  numbers  {^(i)}.  Suppose 
that  arc  i  is  deleted  and  arc  (s,t)  is  added  with  cost  M, 
yielding  a  new  tree  B  =  S  U  7  U  (s,t).  Let  dj^i,,)),  respectively 
d^(i,j)  denote  the  modified  cost  of  arc  (i,j)  with  respect  to 
respectively  [«}.  Then  we  have  for  (i,  j )  e  A, 

i  e  S,  j  e  T  =»  d^(i,j)  -  djj(i,j)  +  (*D(t)  -  M)  . 
i  e  T,  j  €  S  =>  d^(i,j)  =  ajj(i,j)  -  (*D(t)  -  M)  . 

and  for  every  (i,j)  /  (S,T), 

%(i,j)  »  djj(i,j)  >  0  . 

This  implies  that  far  every  forward  arc  (i, j )  in  the  cut  ( S, T ) 
in  1^,  we  have 

d^(i,j)  =  aj,(i,J)  +  (»D(t)  -  m)  . 

Proof:  The  first  part  follows  by  noting  that  for  M  =  nD(t), 
the  node  numbers  and  modified  costs  relative  to  respective  trees  are 
identical.  As  M  is  increased  to  jtp(t)  +  6,  6  >  0,  the  node  numbers 
of  nodes  in  T  are  increased  by  6,  and  the  modified  costs  of  arcs 
across  the  cut  are  affected  as  claimed.  For  the  second  part,  note 


45 


that  if  (i,j)  e  Nf,  (i,j)  e  (S,T),  and  (j,i)  e  A,  then 

d^(i,j)  =  -d^J.i)  =  -djj(j,i)  +  (*D(t)  -  M)  =  d^(i,j)  +  («D(t)  -  M)  .  a 

Theorem  3:  Let  u  3^  U  (s,t)  be  a  basis  tree  for  the 

primal  with  (s,t)  as  the  only  artificial  arc,  and  let  i  denote 

the  arc  which  just  left.  Suppose  that  e..  now  enters,  l  leaves  and 

the  new  basic  tree  is  B£  =  U  3£  U  (s,t).  Let  U  3^  u  £  , 

and  let  u  3^  u  £^.  Then  may  be  obtained  from  by 

pivoting  the  appropriate  dual  variable  associated  with  into  the 
dual  and  pivoting  out  the  variable  associated  with  e  . 

Proof:  Since  £^  is  in  D^,  the  appropriate  dual  variable 

associated  with  l  ,  namely  s,  if  f .  »  0,  u,  if  f.  *  c.  , 

1  \  \  ^  ^ 

can  enter  Combining  Observation  3  with  Lema  1,  the  dual  variable 

associated  with  e  will  be  first  to  leave. 

The  primal  tree  associated  with  the  current  dual  solution  is 

^2  =  *2  U  ^2  U  ^2*  aCL<i  ^he  dual  solu:tion  “ay  Le  verified  to  be  D^.  H 

Theorem  4:  On  problems  with  non-negative  arc  costs,  the  simplex 
method  with  a  most  negative  pivot  rule  and  Big-M  start  and  Lemke*  s 
Complementary  Pivot  algorithm  act  similarly  in  the  following  sense. 

Given  the  same  start,  the  methods  can  generate  the  same  sequence  of 
primal  solutions,  and  will  do  so  when  the  problem  is  non-degenerate. 

Proof:  Suppose  S  u  3  u  (s,t)  is  the  current  Big-M  basis  with 

having  just  left  and  (s,t)  is  the  only  artificial  arc.  Then  an 

equivalent  primal  basis  far  Lemke*  s  algorithm  may  be  obtained  by  adding 

fst 

fts’  Cts>  and  8ettine  z0  =  ~  * 


mbasaitM im 
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The  node  numbers  to  the  dual  complementary  system  are  taken  equal 
to  «D(i)»  where  D  =  8  u  3  u  and  and  defined  according 

to  (*). 

Both  methods  can  now  determine  the  same  incoming  variable  and 
execute  the  same  primal  pivot.  Hie  result  followB  by  repeated  appli¬ 
cation  of  Theorem  3.  B 

Remark;  Any  primal  solution  with  artificial  arcs  other  than 
(s,t)  may  be  replaced  by  an  equivalent  solution  with  those  arcs 
eliminated  as  in  Figure  4c.  Lemke’ s  algorithm  will  simulate  the  Big-M 
Method  when  there  are  multiple  artificial  arcs  if  the  primal  formulation 
is  changed  to  that  of  Figure  8d  and  the  corresponding  dual  solution 
modified  accordingly. 
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Negative  Costs 

The  following  example  shows  that  Big-M  Simplex  (most  negative). 

Out -of -Kilter,  and  Lemke' s  Complementary  Pivot  Algorithm  act  differently 
on  problems  with  negative  costs. 

Big-M  Simplex  (most  negative)  first  au®aents  over  path  s2t. 

Out -of -Kilter,  if  trying  to  bring  (t,s)  into  Kilter,  would  set  all 
negative  costs  to  zero  [19],  and  augment  along  sit.  Lemke' s  method 
sets  the  initial  costs  of  (s,2)  and  (l,t)  to  0-3  and  0-1, 
respectively,  where  0  is  initially  8.  Consequently,  Lemke' s 
method  augments  over  sl2t  first. 

As  noted  by  George  Dantzig,  Lemke* s  Method  is  equivalent  to  the 
Self  Dual  Algorithm  [  6  ]  on  linear  programs. 


Figure  13 :  A  network  problem  for  which  Big-M  Simplex 
(most  negative ),  Out-of -Kilter,  and  Lemke' s 
method  act  differently. 
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Simplex  (with  the  standard  pivot  rule  and  Big-M  start), 

Out-of -Kilter  (Primal-Dual), 

Dual  Simplex  (with  the  standard  pivot  rule), 

Lemke's  Complementary  Pivot  Algorithm. 

All  methods  compute  a  shortest  path  tree  by  mimicking  the  Dijkstra 
algorithm  and  then  send  flow  along  a  sequence  of  minimum  cost  paths. 
Differences  in  implementation  are  discussed.  It  becomes  clear 
that  Dantzig's  simplex  method  with  the  best  empirical  pivot  rule 
(not  the  standard  rule)  will  outperform  other  methods  (variations 
of  Simplex  with  the  standard  rule) .  A  simple  reason  is  given  why 
Dual  Simplex  (best  empirical)  cannot  do  as  well  as  Simplex  (best 
empirical).  It  is  noted  that  network  flow  problems  from  [18]  represent 
pathological  examples  for  all  the  above  methods. 
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